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ABSTRACT ^ ^ ^ 

This issue of ^^Investigations In Science Education** 
contains abstracts and critical analyses of eight articles grouped 
^nto three topical areas: (1) instrument d^Velopnt^nt; (2) attitude 
studies;, and (3) achievement. In addition^ it also contains a 
response to the ^analysis of an a rticie . inwufled in a prior issue. 
Eaqh ab£tract*analysis includes biographical data, research dasxgn 
and procedure, purpose^ research rationale, and the abstractor's 
analysis o'f the research. (PEB) ^ * 
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NOTES PROM THE EDlTOFi^... . .* . i ill 

INSTRUMENT DEVELOP^ENT. . ' 1 

Koa:low> M J James and Marshall A< Nay* *'An Approach to Measuring 

Scleiftific Attitudes." Science Education 60(2) : 147-T72, 1976, 
. Abstracted by ROBERT SHRIGLEY, • • • > 3 



Munby> A, H,, R, J, Kltto, and R, J, .Wilson, ''Vali^ing Constructs 
in Science Education Research The Construct !VSw of Science V" 
Science Education 60(1) :313-321 , July-Sept 1976, 

Al^stracfed by RODNEY DORAK , 11 

ATTITUDE STUDIES, , 23 

Novick, Shimshon and Dina Duvdvani. '*The Scientific Attitudes .of 
Tenth-Grade Students in Israel, as Measured by ..the Scientific 
N Attitude Inventory." School iScience and Mathematics 76(1):9- 



14>1926. . ' 

Abstracted by MICHAEL SZA^p, . . . 25- 

Osborne, Roger. "Using Student Attitudes to Modify Instruction ia 
Physics." Journal of Research in Science Teaching 13(t):525- 
531,197^, 

Abstracted by MARVIN BRATT, * * . ' \ 31 



\ Shrigley, r^ L, "The Function of Professional Reinforcement -in 
^^ Supporting a More Positive Attitude of Elementary Teachers 
V Toward Science.*' Journal of Research in Science Teaching 

14(4):317-322,1977. . ^ ' ' 



Abstracted by'^ CHESTER E, RAUK, • • • , #36 

ACHiEVEMENT • • • • 45 

Bennett, Ray M- "Effects of Previous High School Programs on 

Achievement in College Biology," Journal of College Science 
. Teaching 4(4) : 242- 244, 1975k 

Abstracted by K; JEAN ENOCHS ,47 



Hedges, Larry V, and Kenneth^Majer.^ "Prerequisite Courses as ' 
Predictors of Achievement in the Natural Sciences,** Office 
. of Academic Support and Inatructiohal Services, Unfyersity 
of California, San Piego^La Jolla, February, 1976* 

Abstracted by HERBERT A, SMITH, , % r • • - 54 



teietsetip Arne A- and^^Judith E, Jacobs, '*The &ffecit of Grade' 
^ , Level on Achievement in Biology."' Journal of Research in 
Science Teaching 13(3) : 237- 241 »1976. , \ 

Abstracted by ELLEN^ S, -SIMMONS , , I . . . ^ . 

/ ' \ . ' 
RESPONSE TO ANALYSIS , , • ,^ ' • • ' , \ 



Wlllscm> V^, L, and A, Garibaldi, 'The Association Between 

TeachW' Participation in NSF Institutes and Student Achwemen't, 
Analyzed by E, J, Davis in InvestigSttions in Science Education 
-^3(1) ;58-61> 1977. . - ~ ^ ' , 
Response by VICTOR' L, WILLSOK, " 



HOreS FROM THE EDITORS 



. . With this issue 'of INVESTIGATIONS IN SCIENCE EDUCATION (Volume 5, 
^/Issue 2)/ we welcome^two new TDembers to the Advisory Board: tfillard J. 
JaeobsoDi who is an ERIC'S^EEAC ^Sppointee, and Livingstones* Schneideti 
a HAKST appointee, tfe also wan^ to thank the two persons retiring from 



t^e Advisory Board; David Butts and Kenneth Jacknicke* for their assistan\:e 




during the past several years* 

Issue 2 -of Volume 5 contains eight studies clustered in three area>: 
instrument dev^lopmenti attitudeSi and achievemeitt* It also cbntains 
a response from an Individual whose study was critiqued in a previous 
issue of I ,S,E.<Volume 3; Issue 1). tfe are pleased th^t authors are 
responding to' our offer to allow them to r^ply to questions* requests 
for, clarification, or crfticisms raised by I,S,E» abstractor^* tfe hope 



the dialogue i^ill continue, p. 



Fatricid £* Blosser 
Editor I 



Robert L* Stelner 
Associate Editor 



IHStRUMENT DEVELOPMENT 



ERIC 



K02lov» M* James Marshall A* Nay* '^'An Approach to Measuring 

. Scientific Attitudes/' Sclencg Education > bO(2);147-172; 1976, 
descriptors — *Attltudds; *Attitude Tests;. Educational ^' 
Research; Evaluation; Science Education; Secondary Education; 
^Secondary School Science; ^Scientific Attitudes*; *Test 
Construction . * ' , 

Expanded Abstract and Analysis Prep^ared Especially for I*S,E* by 
Robert L, Shrlgley^ The Pennsylvania State University, ' ^ * 



Purpose " ' 



The purpose of this study was. to design and fleld^test a two^^part • 
Instrument having cognitive and affective components that vould v 
measure scientific attitudes, • . . * 



Rationale ' ' - ' 

* *' 

The steps to designing the instrument verei ^ . 

1, Review and cite the' shortcoming of five Instruments;- 

A) Test on Understanding Science 

B) Attitudes Toward Science and- Scientific Careers 
\ C) Projective Test, of Attitudes 

D) Science Support Scale ' ^ ^ X - 

E) An Inventory of Scientific Attitudes 

, ■ t , 

2, Gifting the difficulty i>ther researches had applying th^ ^ 

Krathwohl taxonomy of affective objectives to the natural 
' sciences^ the authors '^hose Instead the Kay-'Crocker mpdel* 
Prom the 65 affective attributes of scientists Included, In 
the Nay-Crocker Inventory* the authors ' chose eight scienti-^^ 
(ic attributes for their Instrument: 1) ^ritlcal-mindedness; 
f > 2) suspended judgment;; 3) resp.^ct "fpr. evidence; A) honesty;^ 

' / 5) objectivity*; 6) willingness to changer joplnlons; 7) open^ 

mlndedneas; and 8) questioning Attitude/ : ^ 



3* Deslgnfthe Tests of ScleAtlflc Attitude (TOSA)^on,the three 
dimensions of attitude suggested by Rokeach* (cognition^ 
affection l4ntent] and behavior [action])* 



^ . B) J Intent: 



Aj-^f CDgnltl6n; tests the students* understanding of the 

I , ^ ^ manner Jn which sclentlsj;s manifest the 

' scientific attlfiudi^ (resulting; In the 20- 

*i ' statement Cognitive Component Subt^stKICS) • 

tests the students* tendency to approve or dis- 
approve specif Ic^ courses of actloo represent;Lng 
elements af tHe scientific attitude (resultlnfE 
In the 20*statemer\t Intent Component Subtest* 
ICS), ' ^ 

represents the demonstrative behavior of stu- 
dents In the classroom jmplyl^ng a scientific 
attitude (with leach student to^ be judged, by 
sclence^ teachers on a four-point sq^le), 

4*^ A i^ultlple cho'lce format providing the student Jd^th four 

coiirses of action was chosen for XOSA after docu^p^ientlng weak- 
nesses In Thurs'tone's equal-appearing lnterva:^» Lll;iiert*s . 
summated rating*^ and Osg<$oiPs semantic differential tech- 
niques « . « 



c) 



Action: 



Procedures 



* ITslng^Pb^s^d' I anil III o^ Engman*s four-phase model for educational 
planning^ . the authors wrote one gerferal and four or' five spe&lflc 
behavioral^ objectives for each of the eight Kay and Crocker scientific 
attributes*^ The objectives were subiyiltted to judges' who ratkd each 
of them on a 0^2 scale of releyance- As^ a result the^nltlal list of. 
objectives' was reduced to less' than half, Q^enmlndeilness was sub- 

' sumed tinder objectivity and ,the questioning attitude was subsumed ^ 
under crltlc^lnnlndedness^ reducing the eight original categories 



o'f scientific attributes by two. 



.Tyenty-elght multiple choice Items representing the slx^ categjorles 
vere then constructed /and f leld-tested« As a result of a pllbt study^ 
some of the 28- Items wei:e revised 'and 12 ney ones added to complete 

TOSA» 20 Items each for CCS and ICS*/ A panel of judges reacted to 

/ ' / * ' ' ^ t ' 

the Iceyed response for 'each test Item* ^ ^ 

4 . ' 



Fiindliygs 



\m&k Che Instrument vas administered to 307 secondary , school' physics 
and chemistry students the meaiis-fpr TOSA> CCS and ICS were 52,4 > 
52,8 and 52,2 perc^ent^ respectively^ and the standard deviation* 
vere 10. 3> 13,9 and 12,S, ' * > . * 



Item Analysis *, None o£ the alternatives on- the 39'-multlple choice 

Itenk (Item 20 was dropped due to a misprint) was ^Ignored by all > 

students^ but seven of the 156 dlstractors accounted for less than 

3 percent o^ the responses* ^Tve^-ve of^ the 40 Items verf outside the ^ 

desired •2S-,7S difficulty range, Two'of the 39 Items fell well below' 

the desired ,30 on the blserlal correlations, v v ' 

> k 

RetiahiXity . The correlation coefficient between CCS and ICS was ,23> 
well' below the \40 o(M-even» split-half correlation, of TOSA» ^implying 
that Dhe sub^sts were measuring different entitles. Testing for homo*- 
genelty» the KR-20 co^fflc lents for T0SA» CCA and ICS were ,55» •45» 
and •39> respectively. Testing for Instrument stability^ TOSA was 
administered to 105 students during a three-wiSek^ test-retest plan. 
The correlation coefficients for TOSA» CCS and ^C^ were ,71» ,68» and 
,64» respectively. The correlation coefficients for TOSA; CCS and ICS 
with reading as indicated in the scores of 24§^tudents on the Sequen- * 
tlal Test of Educational Progress were ,35> , 41 r^an<P^3b3L respec t Ively 
This Implied less than a strcfng relationship between readln^abllity 
and attitude scopes for physics and chemistry students. 




Validity * Content validity was assumed as a result of the juror 
ment and-^the rlgoribs^^ocedure whereby content was selected f^ T0£ 
Structural validity was examined through factor analysis with 35 bf« th^ 
39 items loading on nine factors. The factor analysis provided reason*- 
able suifport for T08A*s six classifications of sclentlfll^ attitudes^ 
as^ originally categorized b)ri:he at^hors. 

As & means of establishing external validity of TOSA» three science. 



teachers were asked to rat7~th^ scientific attitude of** their -students 



(the n " 151 of, total 307) on a four^polnt scalfi. The correlatlojas of 



teacher ^atings^ with student scores on TOSA» CCS ^n ICS ver^ not only 
loW|,but Inconsistent ftom teacher to teacher*. As a result> the 
authors discarded teacjier'ratings a^ a procedul^e for establishing 
Eternal validity of their attitude Instrument* 

ActtQn Component * By asking teachers to rate 'the scientific attitude 
of 8tud^nts> t^he authors attempted to satisfy the action component of . 
the attitude concept* Because, the correlations between ^eacher ratings 
and student scores wei^e low,, the adtlhors suggest; that action Is not only 
dependent on a prestated , attitude, but also the situation* 

CcnotuhiprtQ . ' ' . / 

The factor analysis supported the author *$ rationale fojc dividing '"^ 
the test Items Into CCS and ICS and also their classification on 
the basis of behavioral, definitions of the attitudes/ 

2, CCS (cognitive) and ICS (lotent) are not measuring tlie same char- 

* , J- 

'acterlstlcs- ' ' 

3, Understanding the attrlb)it^ of the scientists will probably not « 
'\ TOsure that students will detnonstrate thbse characteristics, 

' ' ' ■ ' ' ' - • ■ ' ' . . . -J ' • 

'4v U^lng the analysis data> test items should be modified and 
Instrument lengthentecf/^ - ^ 

5< The*actlon component of attitude needs more attet\tlon< 

,-6, The ^enerallfabUldty shoulSjl be t^roadened by submitting the Instru- * 



mente to a wider population of students*^ 



' . ' ABSTRACTOR'S ANALYSIS 

1, iOSA li obviously developmental and the authors were adequately 
modest In their appraisal of their picofesslonal accomplishments* 

2* When compared with other Instruments measuring scientific attl- 

tude» the authors* major contributions were an Instrument: 

■ 6 ' ^ 



Q,) jvith A more rigorous step^by-st^p rationale^ (2) with a 
ualqii^e multiple choice format^ and* (3) representing science 
plassroom situations^ and experiences/ 

The authors Recognized the Importance of the action compQnent of ^ 
the' attitude concept » a facet of attltyde research In science ' 

:educatlon which Is usually Ignored* The authors confirmed a 



finding so common In attitude research* The literature Is strewn 
vith studies that seen to ^eay a strong relationship between atti- 
tude and behavior, 

Plshbeln and Ajzen (1975) may have come to grips with this problem. 
They question the assumption that there Is a one-to^ne relation^ 
ship between attitude and .5ehavlor» the former r^u^^entlng the - 
stimulus and the latter a response. Instead of a ^Mv€Iatlonsh±p» 
^hey offer the alternative that there Is a probabilistic relation^ 
sblp, 

Becadse of situational factors^ or ^Ht^t Flsl^eln and Ajzen call 
subjective norms Cpreisure from significant referents) »^ a subject 
whose attitude Is* positive would respond positively to many» but 
not necessarily all» manifestations of a part^izular psychological 
object, ^ \ 

For this reason Plshbeln and Ajzen suggest ,that^behavloj: cannot 
be me^ured by a single observation but iratl^er. by repeated 
observations; Kozlow and Kay d6 not report the exact procedure- 
expected of the teachers when they rated fthe scientific behavior 
of the students^ ^ ... 

Central to the authors* rationale was the development of an 
Instrument centered around s±tuatlons^created In the students* 
, science classroom* And this Is probably aworthy objective. So 
their decision to reject the Osgood semantic differential attl-^ 
tude measuring tec^lque with Its unique bipolar adjectives 
format (e,g*> good-bad) was probably justified. 



authors rejected the Xhurstone format on the basis that' ^ . * 
unldimenslonallty Is assumed arid their goal was an Instrument 

representing many dimensions In the affective ^domain, * Even 

^ ' ' ' . ' ' ' r ' • 

more questionable may ^ve been. Thufstone*s^ time*-consumlng and 

Jury^blased- validation procedures for, determining, the negative* 

^sltlve Intensity of attitude statements (Hovland and Sherlf,< 

>^ / ^ . ' ^ . ' ' ^ 

1952)* Although the- authors of TOSA used a dlfj^erenti and^probr 

ably a less- sophisticated^ jury procedure* It 1& possible that 

their system '^3for deterrnlrTlng the **best^* answer for each multiple 

choice Item has a jury^blased prpblem not unlike that of th""^ 

Thurstone technique. 

The authors rejected the Lifcert pr6ce<i,ur^ because of the response 
biased tendency in their testing formats.^ The abstrSctoi^ recog7 
nizes the response bias, in nonHQultiple choice testing .format 
(Oppenhelm, 1966), but the sdcio-psyclioXogiqal literature of the 
last^tvo decades fails' tO' recognize it^as a major concern in 
attitude testing; * ' - / - 

The multiple choice format chosen for TOSA by the authors igncJres 
.attitude intensity* In responding to each .o£ the 40 statements, 
studejits could choose either the correct alternative or one t)f the 
.three incorrect alternatives. There vas^ way a student could 
Tegister intensity of at'titude on each statement as is the case 
/on Thurstone '6 11-point, Osgood*s 7-pQlnt, '^nd Likert 's S-point 
'posltive-n^egative continuum* 

The abstractor suggests that the Likert format with an equal 

lujmber of n&gatlVe and' positive Statements sequenced randomly 

J. ^ * ♦ ♦ 

probably has less handicaps as an attitude measuring, scale, 
especlaliy I^S, than the multiple choice format* . . ^ 

CThe statements on IC$' seem to be the application of standdr^ ^ 
.operating procec^ures ot the scientific community within the milieu 
W the science class-room, thus* they might be considered cognitive, 
even factual in nature^ jnl one of Edvard^s X19S7) 14 criteria ' 
for judging \thc validity^^att^ude statements* is that they^e 



Donfactual. 



Although ch^ authors* correlation of scares on ICS and CCS resulted 
In a low coefficient of .23 Implying that ICS may not be highly cogni- 
tlve» many of the ICS statements seem to lack the likerdislifce polarity^ 
(Zlmbardo jtnd Ebbesen, 1969), that emotionally-charged characteristic 
of attitudes ^CTriandis, 1971),- or the evaluative component that separates 
the concep^of^ attitiHle from other related psycholbgical phenomena 
(Pishbein and Ajzen, '1975^. * ^ 

^' ' > * 

.The abstractor '^suggests that a close eKamioation 'of other ins^truments 

t.' + ■ 

said to measure scientific attitude, even those de^ignedl-aroond a 

* W r . 

Llkert format, s^em to lack some of the characteristics of attitude 

as defined above* Therefore, a more fundamental question is involved* 

Science educators should cons^ider the possibility that a scientific 

attitude rooted firmly in those attributes of jthe scientist may^e 

Inherently more cognitive than the concept of attitude a& defined by 

* 

the social psychologist* Even a .favorable o; unfavorable ^^ittitufle 
toward ^ the subject of science, the learning of science or the teach*- 
Ing^ of science may, not be the same concept nor might^it have a signifi^- 
cant relatio^nship vith the scientific attitude as it was defined in 
this study* ; 



\ 



Therefore, until the concepts, scientific attitude and attitude, are 
found to be. closely related suggesting that su^ct^insrtrximents SOSA 
be designed frem a rationale compatible with the findings ot the 
social, psychologist^ science ec^ucators have to suspend any judgment 
of the authors' unconventional multiple choice format and the;seaQing 
Cognitive nature o^IES, 
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^ 



furpose 

— — * r 

This study had two purposes: ^ 



(1) to demonstrate a ^Methodology ^f or validating Instruments 
employed in science educations research'^ and^, ^ 

(2) to provide "empirical support t;o the conceptual linkage 
— ■'"'"Set we en the philosophical view of science and the intel- 
lectual variables, dogmatism and author±tarianisnt*" 



Rationale 

This study was based on conclusions from several jeviet^^ of science 
education research that' (1) many studies rely on author^constructed 
Instruments whase validity and reliability has been established only 
cursorily, if at all, and*(2) much research is conducted without a 
coherent conceptual or theoretical framework* 

This research was an attempt to demonstrate that theoretically-based', 
psychometrlcallry sQiind validation methodologies can be usedl. the 
liffltrument to be empirically validated was a classrocra observation 
system developed by one of the investigators in his docltoral disser- 
tation . (Munby, 19735, ^ ' ' 



Research Design and Procedure 

The multltralt-multlmethod, model of Campbell and Flske (1959) was used 
to^gulde the selection of instruments and the formulation of hypptheses. 

' ' ' n. 



15 



The following figure displays the written and observation type instru- 
inents that separately assessed the construct in question — *^iew of 
Science,", a convergent construct — ^'Authoritarianism," and h divergent 
construct — "Performance Anxiety," Convergent .measures are those 
deemed to have a "defitf&d conceptual coherence" with the trait in 
question* Similarly, divergent measures a're those that are "c^^c^^P" 
tually understood to have no relationship** to traits A and B* 




CONSTRUCT 



Method 


A 
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B 


Author 1- 
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(convergent) 
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Mature^ of 
Science 
Scale (NOSS) 


4 
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— ' f 


6 PRCS ' \ 



The NOSS was chosen because it had "philosophical bases similar to 
that of the Munby system" and therefore deemed to measure the 
isame trait, using a different me-thcd* Thi^oiigh an analysis of the 
realism-instrumental framework of the Munby system, It appeared that 
realism reflects \xi "authoritarian and dogmatic view about truth and 
about science*" Thus, the convergent observation method chosen was^ 
the Flanders interaction analysis system in which low I^D ratlos^are 
"associated with dogmatic and authoritarian teaching styles*" 

The divergent trait selected for use was "perf orrfance anxiety" — one 
of the few constructs for which more th^n one method of measure was^ ^ 
available* This trait cai> be measured i>y .a "vrritten personal repots 
i>f confidence as a speaker (t^CS) and a timed behavioral checklist 
for performance anxiety in speaking*" There appeared to be no theo- 
/retical reason for this construct "\,*to be related to view of 
science or ^y other construct chosen for this validation sj:iidy****" 



The need , for, this present study surfaced as there were three 
equally attractive/measures available for' the vritt^^n 'assessment 

of the convergent trait (Calif ornia-F, Dogmatism-D, and Dogmatism- 

* ^ 

^E)/* This study was undertaken to assist' in the selection of an 
Instrument for measuring authoritarianism (the convergent trait) 
via a written formaU Accordingly, the "following hypotheses were 
formtflated: < ^ 

V ■ , ^ - ■ 

(1) Scores on the Nature of Science Scale would correlate posi^ 

tlvely and signif icantly^th chose on the Calif ornia-F, 

Dog^atism-D, and Dogmatism->£ scales* 

it) Scores on the PRCS would not correlate with scores on the 
Calif ornia-F, DogmatismrD, and Dogmatism-E scales* 

(3) Random numbers added to the data analysis would show 

Correlatives similar to tho?e. for PRCS, except that they 
^ vould have near-zero reliability* 

^ T^ simplify ,tl^ administration and scoring of the instruments, a 
\ ^ • - 

aiiigj.e test was developed which was composed of items from the 

*Vritten" instruments arr^ged in random order* Also, the response 

format for the NOSS and the PRCS was changed from Truer-False to a 

Likert-type scale (with responses +3-, +2, +1^ -1, -2, -3) to correr- 

spond with that used in the Calif ornia-'F and Dogmatism scales* y < 

Additionally, a "trait" of random^ numbers was included in the ^naly- 

, ' *' 

aia** "Sin.ce the divergent measure performs essentially the same 

function, theoretically, as collecting random numbets, it was ' ■ 

considerexl potentially useful to amplify the validation model****'* 

with the random nunlber trait of "* * *approxima^tely normal distribu- 

* 

tion^ corresponding to the scoring miT\ima and maxima of the real 
instruments*" 

Th^ 154 items of the five written instruments Were administered to , 
"168 secondary school teachers of a variety of subject. specializations. 



The participants were told that tKe purpose of the rgsearcfc^wa^ to 
validate an Instrument, but they were not told the nature 'of varla^ 
bles and instruments* a 



From the response data, scores for the five tests were computed for 
each of the partlclpantis, Desscrlptlve test statistics and rell^bll- 
Itles (split-half with Spearman-Brown correction) were ot;tai4.ned ^or 
each Instrument and correlation coefficients among the f ivfe ^caleg ^ 

rd the "random number" trait were calculated, " 
* ^ . ■■■■ - 

* \ ' * 

^ Findings , ^ ^ 

The following data were the bases for hypothesis testing and resultant 



conclt^slons* 
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29 
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66 


' 30 




Reliability 


• 67 


.84 






• .94 


.16 


*Slgnif leant 


at •Ol 


level. " 


1 " 


* 







The rjellabllltles of the instruments obtained In this study fall 
within .the ranges reported In th^ literatut%« It appears the pooling 
of the items Into one composite test did not unduly affect the charac- 
teri8tlc$v of these instjruments* « 

The convergence of the^vlew of scletjce" construct (as,mea3ured by the 
NOSS) with the authoritarian and dogmatism construct (measured by the 

\ • - ^ 
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D» and F scales) was clearly demonstrated by the significant co^e- 
latlon coefficients among these four variables* Accordingly Hypothesis 
1 was accepted , 

Similarly^ Hypothesis 2 was accepted as the relationships between^the 
PRCS and the and F scales were not slgnlf Icant^ly different from 

zero* Also^ Hypothesis 3 was accepted as the relationships of the 
convergent measures (D^ and F) wltlj^the "random number" trait were 
not significantly d;j-fferenc than with the PRCS, 



Interpretations . " 

The authors concluded that th& Callfornla-F scale was the inost useful 
of the Convergent measures^ because: (1) It correlated best with 
MOSS and (2) correl^ted^he least with PRCS, 

Specifically^ based on the evidence described^ f:he authors concluded 
th^t there was support for the * theoretical position that the view 
of science construct converges with authoritarianism and dogmatism^ 
while It diverges from performance anxiety/' Based on these tentative 
findings^ the investlgatjprs^ will use the Callfornla-F scale and con- 
duct^he validation via the ful^^model (all six boxes) as outlined 
earlier, , ^ 

■ » 

More generally > the at^hors state that this study has shown -t^he 
potential usefulness of the Campbell and Flske. multitralt-multlmethod , 
validation model for science education research and has Illustrated 
the power of this model***/' Further^ t^at the "procedures adopted 
in this research demonstrate the importance^ of proceeding from a 
sound, theoretical framework atid of employing a conceptually sensible 
.and rigorous validation methodology*" 



L 
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ABSTRACTOR'S ANALYSIS . " 

This study attack^df two persistent problems'^for researchers In science 
education. The report commurilcates clearly the Intent,. procedures and 
outcomes of the research/ As this appears to be the' first atudy of 
Its kind, the main empirical study cited w^s a doctoral dissertation 
by one of the authors. This doctoral research was apparently the seed 
from which this study grew. 

The major methodological contribution of this study was the use of the 
Campbell and Flske model^ from* social sciences into. a specific educa^ 
tlon domain,. The relevant dimensions and characteristics of the Camp- 
bell and Flske model were described In a brief but. sufficient manner^. 
This application of the model to science educatj^on research appears 
to be both innovative and appropriate. 

The construct "view of science" basic to tiftls study was defined as 
representing "a basic philosontilc posture toward science and reality,*' 
The diametrically opposing views "realism," and "instrumental ism" as 
described by Kagel (1961) were the cornerstone of the research. The 
Himby classroom observation system was Illustrated via nine statements 
consistent with eiach of these "views," One should consider Kagel*s 
Reservations about over-interpretations of these Stances: 

Xt is therefor^ difficult to e^ape the conclusion that when 
the two apparently opposing views on the cognitive status of f 
theories are each stated with some circumspection, eaeh can ' 
assimilate ^nto its formulations not only the facts cc^c6m- 
Ing the primary .subject matter explored by experimental - 
inquiry but alsb the relevant facts concerning the logic and 
procedure of science. In briaf, the opposition between these 
views is a conflict over preferred modes of speech (p, 152), 

Apparently, these preferences in t^h^ way the process and products of * 
sciencing , are communicated is reflective of one*s philosophical 
beliefs about science. According to Klpiball (1967-68), author of 
tile itOSS: . ' ' . 

Philosophical considerations 'characterize .thoughtful discus- 
sion of the nature of sc:j^ence, so philosophy majors mt^ht^ 
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display a^beDter understanding of .the nature of science than* 

science majors, (p. 111)* ^ . \ * — 

J ■ - ^ * , 

It appears knowledge of specific terms and language used In discussing 

statements aSoUt science may be a function of academic background, 

thereby clouding the assessment of one*^ "view of science'* 

Concern ls\ heightened by Kimball's flfkdlngs that philosophy m^prs 

surprisingly did score significantly higher on the NOSS' than did 

science majors (hlgjier scores Indicating ^greater ^agreement with the 

mod€ir^of the nature oiTs^ilence) * Responses, to s^en Items describing 

the**^ethods of science** were the^maln source of the overall NOSS 

differences* According to Kimball, **Thls Is a^^c^^kable outcome,^ 

for It would seem Reasonable that the one area of ^stlence jwlth which 

' ■ , * * 

the scientists would-be most familiar ^s methodology/' This raises 

the question as to whether the NOSS is meaisurlng understanding 6f 

nature of science or understanding of. the unique philosophical inter- 

pretatlons of nature of science* or understanding of the unique inter* 

pretatlons of certain words and phrases by ttiese schooled in 

philosophy, ^ ^ 



T^e authors listed the nine factx^rs of the realist view and, similarly, 
the nlne^factors ^for the instrumentalist view as operatlPii^llzed in the 
iftinby classroom ob^rvation system, which wasn't used in %he study 
reported here* The-D, E, and F scales^were described as being 
measures of authoritarianism and dogmatism* These traits w^e /^^ 
characterized by Roke^ch (1960) as assoclated^lth * ^concrete think- 
lng> dvitolerance *of ambiguity, and premature' c^osui;e of perceptual 
process*" The D and E forms of the Rokeach Dogmatism scale aro^ndi- 
dated as the fourth and fifth revision* ^ Further^ they are ttfe^^^j^bed 
^s Dogmatism and Enthrocentrism scales, respectively* However> no 
illustrative items were Included; rather, psychometric data were 
listed for each^ e*g* means and reliabilities* Th^ reliability data 
for D Scale was described by Munby £t al* of; a s3<6ple of "English 
majors," while it was "students lof University College in London," 
according to Robinson and Shavet (1973)* 



From th6 xeporc It appeared chat the- California-^F scale was developed 

Sy Jlokeach, ^ However, It was designed by Adoirno and colleagoes^f 1950) ^ 

to measure 7* * < ^ntisemitlsm and ethno-centrism witlVQut ijfentioning ^ 

minority groups or current political-^economic is5ues<<<^^* (p< 223)*' 

'^e new instrument was termed the F sqale^ tCL signify its concern 
' ' ' } * ' ' ■ ^ ' ' " . I ) 

vwith implicit prefascis^ tendencies, • (p, 224), Vhich ofeth^ [three 

forms of the F*scale was used in this study was not st4!ted«< Th^ Tovm^ 

78 Form .60^ and Foni 4b/4S contained 38, 34, afid 30- interns respectively • 

Munby et al, reportj^d 29 items in the California F-soale and <lid not« • 

list any 'reliability estimates* ^ The F-scale as ap^en^ed <ix^he .Rokeach 

(196.0) volume included just 29 items, eliminating the itgm ^*the true 

toe&lcan way of life is disappearing so fast that .^otce may bd n^es- 

. \ ^ ^ 

sary to 'preserve it<*^ Further^ thfs- item may have been ct>nsidered as 

irrelevant to the" Canadian sample, Robinson and Shaver {1973) reported 

reliabilities of the F-scaie .as follows: . 



The reliability (split-half) bntfForm 78 over all. groups 
«74« Group rej. labilities ranged frpm ,56 to ^88« ^-Fj^rm 60 
^ had a reliability of ,87 over aTl groups tested, witt) group 

. I reliabilities ranging from* ,81 to •91, * Forms |fS and ^0 had * . 
a reliability of ,90 over all groups teste^d. Individual S ^ ' 
group mean^ varied from ^^81 to *9*7 Cp^ 422), ' -^ * ' ^ 

The dat^ in the Munby el^ al« report on the F-scale lifted Itlchiigan U< 
as one of the groups sampled* Accoi^ding to^Rokeach (1960) it was 
■Michigan State University, 



The itemst^om the several inventories were administered to **168 
secondary school teachers of a variety of subject specialiiat icins, " * 
It, seemed that the study-was oriented to science t^eaching and jscience 
teachers* How this sample will assist^ for thar purpose-.is not cleaf^l 

Bivar'iate correlation coefficients were calculated 'betw^n the' &otal 
scores of the four scales and the^randdm number variable." Conclu-> 
Sions based on the calculated statistics and- testing of ^hypothe^es 
seemed ^appropriate and well-foundad. The ih\^stigators failed to 
relate these, findings to. those*cited by Rgkdach (1956)\as citetf in 
Robinson" and Shaver (1973). , " ' # ^ . 



Xnc^rcorrelatlons among the and F scales with seven different 

samples I varying In size from 60 ^to 202 were cited In the Robinson 
and Shaver volume (1973), The D-E correlations ranged from ,31, to ' 
*53>'1>-F from ,54 to ,77 and E-F correlations 'fjpw^ ,56 to ,64, Tfie 
results cited In the Munby et al, report are consistent with these 
flndj^ngs, . , V ' " ^ S ' , 

While It was not important fon this study* It would -have been Inter- 
.estlng to have had a ^rlef description of the degree of dogmatism- 
authoritarianism Iri this sample of teachers, . 
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The D scale was composed of 66 i*t^ms wlth^a range of possible scores . 
of 66 to 462 (with the scoring conversion). The neutral^ position 
would c^i:;^spond to a score of 26^; Me^n$ abov^ that would be inter-^ 
preted ^s Indicating a higher degree of dogmatism. The Bample of 
317 college students cited by Munby had a m^an of 219* almost exactly 
the same as the Mui^y sample— 220, Those values 'could' be described 
as non-dogmatlC| although n^ strongly so, « ^ ^ 

Similarly* the £ scale scores could range from 40^ to 280 with a - ^ 
neutral position corresponding to a score of 160, The student samples 
investigated by Rokeach had means ranging £.rom 14*1 to 1A4| with the ^ ^ 
tfuiiby teacher sample , having a mean of 134, Agalni l^oth sets of data 

could be^described as slightly non^enthnocentrlc, 

, , , > * ' ' 

Possible scates on the'F scale f^rfg^ from ?9 to 203 with a ^leutral 
position of 116.,^ The data collected from students by Rokeach had 
mean values from 83 to 116, .The llunby sample >had a mean of 94 — oik^ 
againi similar *to t^ Rokeach sample and below the middle position,, 

Performance , Anxiety may be a somewhat different ' tisait than Anxiety 
In generali although they .initially seem to have considerable common-* 
ajlty, * Rokeach (1960) did suggest that ^ 

;44tb the extent ^that a be ^ef -disbelief system is closedi 
it represents. a cognitive network of defenses against 
anxiety, "This* leads us to the simple hypothesis that 
those with rel^atlvely closed system^ should manifest more 
janxlet^ than those'/with relatively open system (p, 347), 

^ ■ ' ' 

I, 



Rokeath obtained data relating to this hypothesis from a variety of 
groups In the United States and England. In/all cases the *Wasure 
of anxiety used was 30 items from the Minnesota Multiphasic 
Personality Inventory (MMPI)," Some typical Items werei* 

I Work under ^a great deal of^ tension* ^ 
I have nightmares every few nights* 
Ify sleep is fitful and disturbed* 

I frequently notice my hand shake when^ I try po do something*^ * 

The correlations on the groups, with the number of ^subjects ranging, 
front 60 to 207, between the Dogmaclsm and Anxiety scales ranged from 
*36 to *64, all very significant* i \ ■ * " 



Th^se results are^ery different /rom findings of ^unby and colleagues' 
between the Dogmatism scales <D, E, and F) and the PRCS, their measure 

of performance anxiety* A riumber of possible explanations of these 

* » ' 

dl^erences may be possible, but are beyond the scope of this abstract ^ 

* * ^ ' . 

The authors correctly identified this study as "an eariy portion of 

the effort to >put an elaborated philosophical distinction to emplri- ^ 

^ cal test****" Comprehending phllpsoph'icaL considerations is a . 

^welght;^ problem by itself* Adding two methods ^of assessing traits 

which are' dlfficult^to conceptualize makes the t^k ^truly immense* 

The investigators have done an admirable job in this difficult dpntain* 

It is hoped tha't they * continue to contrifi^te to this research endeavor* 
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,N6vlek, Shijnshon and Dlna Duvdvanl* * "The ^Scientific Attitudes -of 
Tenth-Grade Students In Israel, as Measuted by the Scientific 
' Attitude Inventory," School Science and llath^atlcs , 76(1); 
9-X4»' 1976* ^ ' ^ ' 

Descriptors — ^Educational Research; International^ Education; 
Science Edudatlon; ^Secondary School Science; Secondary. 
f Education; *^Sclentlflc Attitudes; ^Surveys; Scientists 

Bjtpanded Abstract and Analysis Prepared Especially for I,S-E* by 
Michael S2abo» The Pennsylvania State University, ' 



Purpose ' ' 

In the teceht pas^:* the Rational Association for Research In Science* 

r 

Teaching has underscored the value o^ attltudlnal research In science 
teaching by elevating It on the p^r^orlty listing. This emphasis has 
produced a number of studies on the affective component of sciences 
teaching Including the present study by Novlck and Duvdvanl who 
studied scientific attitudes in tenth-grade Israeli school studeitt;,s 
who had been exposed to the "big three" science courses; biology^ 
chemistry^ and physics, • * ' 



Rationale * 

The authors pr'^sented* no rationale for this study* The reviewer " 
Infers that the rationale was a comparison of scientific attitude^, 
of students in publjic schools IA two nations lyith somei^hat siMlar 
economic orientat'lons* Of all th^ prior research done in the area 
of scientific attitudes , only that of Mpore^ dhe original author 
of the Scientific Attitude Inventory- (SAI) instrument^ was presented. 



' Research Deslfin and Procjsdure - 

The design of this study*was a non^equlvalent coioparison group study 
using randomly chosen classes (n^684) from within the strata of 
different school^types in Israel, the comparison group was drawn 



25 



from literature reporting the results of a test with nlnth'-grade 
students In th^ United States and with a college^^saniple Instructed 
In 4 physical science course for non-scientists. The data on the * 
Comparison group were gathered In the United States during the 
1970s while the data were gathered from the Israeli schoo^s in 
1973, The sample sizes of Intact classes were essentially^ equlvar^ ' 
lent In the Israeli and comparison .schools. The comparison and the 
Israeli schools were- not sampled randomly^ * > ^ 

The Instrument used was the'Splentlf Ic Attitude Inventory (SAI). 
which Is a Llkert-type Instrument designed to measure the extent 
to i^ii;h a student assumes six pairs of positive or negative sclexb* 
tlflc attitudes* The Instrument contains 60 ltems» 6 per attitude. 
The first three attltudlnal components bear an Intellectual orien- 
tation i^^e the remaining three attitudes reportedly bear'&n 
emotional attitude toward science. The reliability and validity 
of the original Instrument are reported by reference only. The 
Instrument was translated Into the Hebrew language and reportedly 
validated In the same manner as the original instrument, Ko data 
were given on this validation except that the overall reliability 
coefficient from the Israeli study was 0,58, 

The data collected Included means and standard deviations which 
were computed and compared for the total Tsraell sample and the 
individual United States samples, Ko statistical tests of means 
were performed. The summary means and standard deviations were 
reported for the total test» the individual subscales and the two' 
subscales 'which were summed across the first three and the last 
three scales, ^ Mo reliability or validity data were' reported oi^ 
any of the subscales, " ' ' 



Andinps J - . 

*■ 

The authors reported*tHat the Israeli mean scores compared favorably 
with the m^n scores for the U,S, data for the total! an4 a^l 

■ ■/•■ . ■■■ ; . '■ 
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0ub8Cdles< The authors inferred that Israeli students consider 
scientific work interesting and rewarding, to a greater extent than 
Aid the U,S. sample. They speculate this difference might be due 
CO cultural-technological interactions which were a function of the 
1970s in the United Stal?fes and -1973 in Israel. They al^o speculate 
the heightetted awareness in the United States of environmental effects 
88 a potential contributor to this supposed discrepancy* 

The authors also inferred that the need for public support and under- 
standing of science was appreciated more in the Unified States than it 
was in Israel. \ ^ 



Interpretations 

A portion of the findings and discussion addressed the unidiniension- 
allty of the attitudes being measured^ The. argutoen^ was put forth 
that a unidimensional ^attitude would result in small differences 
between mean scores for the positive and the negative statement of an 
attitude* In fact» the data showed the difference between* the means 
on positive and negative statements for each attitude to be large* 
No statistical tests of significance were reported on these mean 
scores. As a further excursion into this issue of unidimensionality^ 
correlations betwee^ positive and negative statements for each attitude 
were made* Thr^e of the six correlations ver^e 'significant at 'the *01 
level ^nd two of these wete positive* J ' 

The authors questioned the linidimensionality of the instrument and ' 
referred tp Moore's 'interpretation which centers on the notion that 
students do not seem to understand the nature of scientific explana- 
tions 'in the form of theories and laws regarding the first attitudinal 
component. This statement calls into mnd 't:he very close and not 
fully understood link between intellectual' knowledge and attitudinal 
development* The authors concluded that the development of scientl- * 
*f±c attitudes required much more explicit attention in Current Israeli 
science programs, ' ^ p ^ 



27 

29 



ABSTRACTOR'S ANALYSIS - . 

/ ' ^: 

Ab Sir Isaac U^on indicated, greatness*^ in part stems from standing on 
the shoulders of giants vho have gone before* Similarly* those dealing 
vith education in^ an empirical manner would be veil advised .to consult ^ 
the research and theoretical litei^ature as a basia for their work* 
Pot example, Wagner and Sherwood (1969), Festinger (1957), Shrigley,, 
Riley and Johnson (1976) and Shrigley (1978) suggest, four models of 
attitude development from a theore'tical basis* 



In the deaign, there is^little description of similarities and differ- 
ences between the comparative samples. This 'lack of iriformatiod 
severely restricts the abHity to make inferences and .generalizations* 

, For example, during 1970, tremendous change was occurring in the 
Cultural and social structure of this country^ Such. changes included 
a growing awareness of the deleterious effects of science and tech-^ 
nology on the environment, an emphasis, on Che use of technology for 
war time purposes, and a sharp drop in the demand for some- scienti- 
flcall^ trained persons, such as engineers* Although space 
limited, the authors might have provided a brief statement of the 

. nature of the .sam^TiSs that wer^ used as a comparison* 

tinder the heading of instrumentation, the reviewer 'would like to 
Comment on cultural validity, reliability, and unidlmensionality* 
Although the instrujitent w^ translated verbally from ^ngXish into 
the Hebrew,' there was no repqrt on a cultural translation* It is 
well documented that tests c4n carry biases when used in a culture 
for which they were not designed* Cultural bias can even, occyr 
within the same culture* Witness the trend in recent years' towards ^ 
technologically and practically based research yerfcus theoretical 
studies in the sciences, a result largely of changes la funding 
patterns by^ the federal government* One can only speculate as to ^ 
the Cultural biases that may have been introduced in this particular 
study* » 

Although the authors indicated the^ use of similar procedures in vali- 
dating the^ translated instrument, no data were presented to indicate 

28 . 
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the validity of the InStrutnent or Its subscales. The reliability 
of the total Instrument wlS^O,58 which Is clearly questionable, , 
Standard errors of measurement were not presented in this report. 
Although conclusions were speculated regarding- the subscale scores^ 
neither the reliability qor the validity of any of the subscale. 
Scores was mentioned. Coupled w'lth'the fact that uo statistical 
tests were performed with the exception of the correlation coeffl^ 
clcnts, it' appears that any conclusions or generalizations are truly 
speculative at this point, \ ^ • ' ' . 

.Ihe authors' raised , the question of the uijidimenslonallty of the atti*- 
tude underlying this particular instrument. The reviewer^ however^ 
would like to raise .the question of the unldlmenslonallty of the 
attitude scales embodied in the SAI, ^^l^^^^the scales unldlihensional, 
"it would seem that mean scores on the posftCTfe statement and nega- 
tive statement would be inversely correlated, " However, the correla- 
tion betw^te positive and negative pairs across all six subscales 
indicates little^ if any^ significant correlation and of the three 
significant correlations, only one is in the negative direction. 
The argument presented by the revlewet is in direct opposition to 
the arguments made by the authors which predict positive correla" 
tions on the scaled pairs. 

The problem of unidlmenslonallty is a severe one and Is further 
Supported by the Instrument itself. Scale 4a> for exan^le^ starts 
out with the statement that science is an idea-generating activity 
while scale 4b, the supposedly negative view of the same concept, 
suggests that science is a technology-developing activity^ Theo^ 
retlcally, if one" rates statement 4a highly^ he would then, rate 4b 
low. The face value of these two statements* however, is such t-hat 
the student with a strong understanding of public funding patterns 
would rate both these statements highly. The naive student who had 
memorized a definition of science versus technology might rate 4a 
high and 4b low. ' ' . * . . 

Related to the issue of unldimenslonaHty is abeence"^ of data on the 

uPiquepess of subscales 1-6 or the^two larger subsca^^^s'^tm-attituile 

versus Intellect in the tnStjrument itself, 
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The conclusions based upon th^ subscales are unwarranted In Che light 
of the absence of reliability figures for subscales and the lack of 
test8 of significance* " ' . 

Assuming Ihe above probleins ar^ stralghtenfifd out> the reviewer would 
like to Qiake three suggestions* First, *5^ese data are correlational 
and subject to the Influence. of other variables* Some of these can 
be measured and partlaled out, others cannot* Those which can be 
measured and partlaled out, using partial .correlation techniques 
should be* Somewhat more precise statem^ts could J:hen be laade* 

SecovA^ an analysis of response by school types (vocaVl^onal, academic^ 
religious, etc*) would appear'f rultful* * 

Discrepancies between paper and pencil responses and actual ^ehavlors 
ha^e been docutnented in ot;her areas (e*g*^ marketing research)* If 
these discrepancies occur in attitudes toward science^* the iiferences/ 
Conclusions^ .^d resxilting course^ of .action may- be ^erroneous • 

The knowledge c&ioponent ^attitude has long been questioned* If the 
first threfe subscales of the SAI do Indeed measure an Intellectual 
<i*e*^ knowledge acquisition) component arid £iib next three are attl- 
tudlnal^ it may be possible to use-^e first three substales to partial 
^the Intellectual component from the attltudlnal^ Ueavlng a more pure 
^assessment of att^^de* Empirical support* fo^ this distinction^^ 
perhap^through factor analytic techniques^ should be employed. 

* 
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>r ' ' , ^ ^ . ' 

The purpose of this study was gather information concei;ning students 
perceptions of laboratory work in a unlverslty-^level physics cou;r^e* 
This information could then be used as a bas^j^j^r declsl6a-maklng in 
the planning of future courses* 

■ * 

Rationale ^ 

The' study as such was not related to anv previous studies in the area* 
'N(^ontextpa«L framework or model was mentioned* However, the author 

quotes Stuff lebeam's definition for evaluation as '*the process of 
, delineating, obtaining and providing useful information "for judging 
.decision alternatives* 'V ^ 



Research Design and Procedures 

This was a formative evaluation study Involving two measures of student 
attitude over a two-year period in order to modify a college- level 
physics course* Perhaps the studies could be described as **post-^test 
only" designs* In the first study, conducted in 1973, 53 studehts 
enrolled in the course completed five units 'of work* ^Upon cpmpletlon 
of the course^ these subjects completed a 26-ltem semantic differen- 
tial attitude inventory* These data were used to construct profiles 
which were compared to similar data collected 'the* following year, 1974*^ 
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The 1974 study vas conducted with 80 subjects^ also students In the 

physics course. In shorty the researcher collected attitude data with 

a semantic differential; he then changed or In some way modified three 
/ 

of the Instructional units (laboratory work). The second year he * 
gathered data using the same Instrument » constructed profiles and 
looked for differences across the adjective pairs," 



In addition to the above^ the researcher also subjected the data to 
factor analysis. Using the Kaiser varimax method he rotated the data 
orthogonally and found four significant factors and one^whlch was 
mixed. The factor analysis data and the profiles for each year were^^ 
Illustrate graphically, , 



Findings 

The finding^ In thls'study may be summarized as follovs: 



1, 50 percent of the students surveyed upon completion of the 
physics course Jh ad changed their, attitudes toward physics 
In a positive direction^ 2Q percent considered .their attl^ 
tudes mpre negative, ^ 

2, Laboratory studies appear to Influence student Interest In 
planning experiments^ analyzing the results of experiments^ 
appreciating the nature of physics and Interest In physics, 

3* Varying the activities In the laboratory setting .slgnlfl- *^ 
^ cantiy-<p^ 0,01) changed the mean values on experiment one 
bipolar adjectives: short-long^ straight-forward th|eoty- 

complex theory and varied-monotonous. These data ^e dls** 

* ♦ ii - 

played In graphical form as profiles. 
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Of^reseai^ph In the affective domain* Perhaps more precision is required 

In the area of measurement* Th^re lS| howeveri 'no question that the 

data Collected can be usefal in decision makUng By physics Instructors . 

In the university setting* 



Sevejtal questions could be asked about the study as It stands* The 
Infonoatlon presented In taBular^£orm concerning student opinion is 
vague* Tk«c^ are no defined parameters from which one could argue 
student opinion and the^most effective learning environments (Table 
1)* The author spent valuable space describing the ptocedures used 
In the factor analysis of the instrument which d6es*not relate to 
the objectivie of his study* It would seem that the factors he des* 
cribed are related to each other » therefore begging the use of an 
oblique solution in preference to the orthogonal— solution chosen* 
Too many studies of this type fall to describe precisely what varia- 
bles were changed 'in the instructional sequence^^ Even studies which 
use Harvard Project Physics, Chem-^Study^ Chemistry or BSCS Biology, as , 
experlm^ental treatments do not .describe* exactly what has happened 3p 
that future researchers could replicate the studies* In this studyi 
changes, were made in the fltst laboratory activity — it would seem 
that the f irst laboratory experience wou^ld not be^The "best" unit *of 
Work to attack* One additional comment that is pertinent ** *pethaps 
a pre-post testing design would have been more Informative in this 
studyi especially if the researcher was committed to making major 
Investments of time and energy Invo Ivlng changes in the course acti- 
vities* * ' , * ■ ■ 

* t 
The study does add^ a dimension to the area of research- on i^ttltudes 
towards science and sclence/teachlng* It is a. demonstration that 
Information gained in research can be applied to discrete and press- 
ing problems* The factor analysis data tend to support other studles^ 
In this areai especially when viewed along with profile data*^ The 
negative feelingF demonstrated towards mathe^iia^Ucal aspects of physics 
have been a serious concern ,to researchers for some time* Kormall-y 
one looks for ten subjects/cell when <}«aling witl; fia^ctov analyses on 
data matrices* A 26 x 26 matrix would require vrojghly 6500*7000 

' ■ ■ - ■ /f' 
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subjects* ' Cattell <1973)| howeveri has' suggested that factor solutions 
may' Indeed be valid for much smaller s^ples or 's{(bjectf/cell ratios/ 
Perhaps further research could also use cluster analysis programs or 
multidimensional scaling techniques as a comparison to £adtor 'analytic 
cal models* In e&senc€!'| the procedure<^ea(ls to the assumptloit of 
construct valldlty^or the attitude inventory (Bratt, 



Just^as a point worth noting^ the researcher <^ld not describe^ the -sta- 
ti^tlcal tests used to determine sigoif leant positive chwge^ 
attitudes — this would h^ii nfeaningful* Oyerall|,the report 

is very interesting. Some of the details are hurled add Somewhat' 
confusing* Perhaps more discussion of, exactly whai; c hang ed'^bet ween 
1973'and 1974 voiilA. be more ^helpful to the reader. ./ ' 
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Hhtlglcy^^ R» Function Of Professiortal Reinforcement^ in 

Sttpportinti A More Positive Atteitude of Elementary Teachers , 
• Totfar4 Scloncc/' Journal of Research in Science, Teaching t 14(4) 
317-322, J077/ 

Descriptors — -^Attitudes; Change Strategies; Educational 
Research; Elementary Education; *Elementary School Science;' 
♦Elementary School Teachers; Inservice Teacher Education; 
^ *Scleu<^ Course Improvement Project; .Science Education; 
*Survoys 

Expanded Abstr^tct and Analysis Prepared Especially for I*S*E, by 
Chester E, Raun^ Temple University, 



INirpose 

The purpose of thi^ study was to: 



1) Survey the attitudes of elementary school teachers toward 
the teaching of science* 

2) Classify the responses with 8 or 10 broad 'barriers to science 
teaching, 

3) Examine the barriers for a possible relationship to one or 
more of the four funttions of Kat^*s (1960) functional 
approach to attitude change*^ 

4) .Retiommend whether* pr not Katz^s approach seems to be a valid 
theory on which hypotheses could be established and experi- 
m^tal studies^ designea to test attitude , Change of teachers* 



Rationale . 

1 

' F » ' * 

The Investigator attempted to construct ^ relationship 1>etween his 
observations that **the^e seems to be.Ji.ttle professiorf^l reward for 
the teacher who teaches science to children*^ and that to be success^ 
iuX at the Implementation of su,ch science programs as SAPA^ SCIS or 
locall^ developed curriculum, there might be a need to analyze 
''other** professional needs> specifically those that spring from an 
Uttitudtnal source* He raised the fellowing questions: 

1) .Could the lack of professional reinforcement be the source 
of the less than positive^ attitude elementary teachers have 
^ ' toward the te4?:hing of science? ' ^ 
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\2) Is there a theoretical bdsls In the ^jttltude literature of the 
social psychologist *thSt seems to support the hypothesis that 
teachers* may need greater professional reward for sAence 
teaching? ■ \ * , ' ' * 

3) Could ^atz*s functional approach to attitude change be a valid 
theoretical basis for the Investigation of attitudes In teacher 
education? 



The investigator Identified a basic assumption of the functional approach 
as drawn from Wagner and Sherwood (1969)* This assumption was **th^ attl- 
tudes develop and change as they serve' to prdmote or support goals of the 
^ Individual; that ls» ^attitudes are Instrumental' to the person*s satisfac- 
tion of^hls needs," ^ 

^The four functions of Katz*s functional approach are: (ij utilitarian, , 
(2) knowledge^ (3) value^^expresslng^ apd (U) 6go-defenslve, Thenlnves- 
' tlgator _gave a description of each which appears to be his Interpreta- 
tions of Katz*s approach as applied to teachersv* For^ example, the 
Investigator stated .that the utilitarian function of Katz*s approach 
suggests that teachers ^111 modify their attitude toward the teaching 
of science w^en the change maximizes rewards and. minimizes punlshmefrtT 
He suggested that perhaps '^teachers are not as reinforced by the school, 
community for teaching science as they are for teaching reading, math 
and' other subjects, Or» administrative restraints may swerve indirectly 
as punishment to the teacher who teaches science. Therefore^ changing 
teachers* attitudes could require external rewards In the form of mater- 

"ISIs", equipment, ""or smaller classes. 

Similar logic was used to describe the other three functions with the 
Investigator "acknowledging that the ego-defenalve function may be a 
limitation of the-stydy, 

* ^ There Is no attempt to cite pi^vlous research related to bhe investiga- 
tor's study* There were however^ a nuipber of related studies completed 
during the 19SOs and the 1960s Including studies by this abstractor and 
Colleagues, ^ 
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The Investigator develoMd a simple^ open-respons^statement\to survey 
the attl?tudes of teache* concerning barriers to^sclence tea'chlng. The 
questionnaire — InsJtruntent was piloted with 239 Inservlce^ teachers* The 
Instrument Included: 

1) The statement:^ "I will*teach more science If/when,,," , 

2) The, directions: "Complete th»-9tatement In as few words-as 
possible," not Identify yourself/' 

3) A question as to grade level taught* 

A) A question as to whether the teacher has used SAPA> SCIS» ' 
■ or ESs materials. 



To establish Interratet reliability, the Investigator randomly selected 
SO teacher statements from the total responses and presented these to a 
jury of four teacher educators who were to use a procedure Identical to 
that of the Investigator^ namely: > ^ ' . 

1) .Classify each of the 50 responses in one of the foHowlhg ten* 
categories: software » hardware » {lme» teaching skills » admin** 
IsH^lve restraints^ other subjects^ asslstance> studant>. 
miscellaneous » or^I already teach science* 

.2) If a response is really a multiple response with more than'one 
, barrier (category) noted> record only the first barrier, 

Vhen the response is "materials^" assume that the respondent 
-means "software" and not "hardware*" 

A^mean percentage agreement among the Jurors of 82*5 was reported* 

Consistency of results in ranking of the categories led the investigator 
to conclude that the Instrument was reliable* Id the pilot sample 85 
percent cited a barrier (category) with the rankings as identified in 
the first procedure aJbove* ^ ' ' \ ' ' 

AesmalDg that a change In the free response open^^ended statejffent from 
*'teach pore science" to "teaching science more ef^ebtlvely" would raise ^ 
Ih^ pc^rcentage of respondertts citing barriers^ the Instrument was admin- 
istered to a "survey sample of 449 teachers representing a cross section 
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of elementary and ^special education* A higher percentage of teachers 
were from grades 4*6 than K*3 with at least 20 pfercent ^slng SApA> 
SCIS» ^r ESS inaterlal&.&lo their classrooms* ^ ^ ^ 

4 

The sample represented teachers from 14 school districts (7 rural » 5 
^burbaiH Z urban) and 13 Inservlc'e classes at 7 cpllege^ and i^iver- 

sltles Irt eight states* ^ - 

y 

Th^data from both the;pllot study and the s^^g^y sample were recorded 
in a^ summary table Indicating a percentage Of teacher responsiSs for 
each of the ten categories knd a relationship to one of Katz*s func- 
tlons. * , ' 



Findings - \ ■ • 

% ■ 

The investigator classified all of the 449 teacher responses and judged 
which of Katz*s four functions seemed most congruent with each of the 
categories* The results were:, , ' , 

1) Software^ h^Xdware» tJLine» removal of administrative restraints^ 
and assistance accounted for 78 percent. 'of th^ teachers^ res- 
ponses and seemed to be ,suppof ted by Ka^tz^s utilitarian function 

2) Teaching skills^ wfilch seemed to be support^ by Katz*s know^ 
ledge function^ accounted for,, 10 percent of the responses* 

3) Placing sclgnce pn a level below other subjects and tochers* 
qUestlonlng^of the child's need for or interest In science 
sccounted for iour percent tyf the responses and seemed to be ^ 
Supported by Kacz's value-expres^on function* 

4) There were no responses that seemed to be supported by the ^ 
eg<H^ef enslve function* 

fnterpretatlons ' . 

T^e invesClgaCof. concluded Chac: 

' 1)( Most of Che teachers* responses seemed Co be supported by one 
' ' of KaCz's cHree functions: uCllYtarlan, knowledge, or value-: 
expression. ' . " - 
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2) The fcnowledge and value- express ion components functlbned.at^ 
a low level, - 

\ ^ - . . 

3) The survey failed to reveal the egc^- defensive function. 

In addition to tliese <^oncluslons the investigator extracted several 
Implications regarding the inservice teacher j 



1) That the attitude of eleioentary school' teachers> 'and there- 
fore the improvement of the teaching of sclence>' rests ^ 

/primarily in forces ^outside the control of teachers them- 
selves, ■ " • , * ■ 

* , 

2) ^-5hat pr*Lncipals and si^rvlsors Should reinforce a positive * 
attitude by exercising leadership in ihtegratlng science 
materials into the local science teaching milieu by provid- 
ing accessibility of materials, and by planning to replace , < 
expendables methodically, ^ , - 

3) That school officials and science educators could team up to 
provide teachers with such teaching skills as oral question* 
Ing, teaching strategies.> and^ a cla^room climate amenable to 

^the teaching of Investigative science, 

4X Aides and/or administrative help is needed to assMt teachers 
In t^e preparation of sclenceumaterlals, 

5) There is a .need to establish sclet^ce as a legitimate subject 
In the local school curriculum, , 

1 ■ . ^ ; 

^ ^ ' * * ■ * 

The investigator indicated that the study/dld not ^reinforce traditional 

views of teachei^s being , altruistic nor rhat professional motivations \ 

come ^from vlthln. The study did not reveal personajl 'dislike or dls- 

conifort associated with teaching sclencf' and the investigator ^cknoi^* 

ledged the exlstence^of other undisclosed motives that Interfere, vlth 

some elementary teachers embracing science, * 

' ABSTRACTOR'S ANALYSIS ^ 

The Investigator attempted to explore both t^e question of professional 
reinforcement' as a means of creating a more positive attitude on the 
part of elementary teachers toward science and^^e possibility of > 
theoretical basis for investigating attitudes in teacher education. 
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In developing his rationale the Investigator did not draw upon precede 

Ing i'es€(arch which studied, el^entary teacher attitudes toward silence* 

* ^- ' * 

SeveraK^uch' studies exist and their strengths or weakness^ may have 

aided In th^ development of this ^ study. For exasiple, In the knowledge 

function tfie Investigator Includes teaching skills, knowledge, method^ 

experience, and Interest,^ A stqdy by White, , Butts and Raun (1969) Indicated 

that previous teaching experience does not appear to be related to 

competence, In science but does appear to be related to a teacher's 

attitude* In another study. Butts and Raun (1970) found that few or 

no formal science, courses for elementary teachers resulted In a more 

positive attitude towards science* The findings of these and other 

studies are certalnljc related to this study. - ' ^ 

The investigator in discussing the value-^expressive function suggests 
that sex may make a difference since "85 percent^ of elementary ^^^ool 
faculty persont\el are females who view science' as ^ male^enterpr^m^" 
This is entirely possible^ yet in the study^ both pilot and survey, 
there is no indication that' the sex of the respondents was obtained. 
If the saii^ple was entirely female^ are. the results biased? 

N6t only w3s omitting t^ie ego-def ensiye function an unnecessary 11ml- * ' 
tatloix of the study but a question concerning a teacher*s dislike or 
fear of science should have been included. There should also have 
been an attempt to collect factual information beyond grade l^el 
taught and use of SAPA^^CIST^ or ESS materials, A dislike or fear 
of science ^'y be due to many variables^ not the least of which is a 
lack of science content knowledge* Questions- to seek information on 
content hours in science^ type of science instruction received^ etc,> 
would have bfeen appropriate, 

V 

The open question survey lnst;^ment is helpful if depth information 
la sought or there is uncertainty as to what the responses might be\ 
It requires a large thpe Investment in interpreting £(hd categorizing 
responses. It is also inheifentiy subjective and, as the investigator 
acknowledges, he classified responses Ihto ten broad categories and ^ ^ 
he ' ju<!ged which of the four components of Katz's 'functional approach 
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Supported the categories* The consistency of rankings of the cate- 
gories was used by the investigator to justify reliability* of ^ 
Instrument/ Consistency is normally an indicator of reliability l}ut 
^rman (1968) considers the open question survey instrument as having 
low reliability beca^^ of Inherent subjectivity, ^ 



In considering the category of "I already teach enough science," which . 
vas used in the pilot sample, the investigator reported a re^p6nse rate 
of \i percent which left 35 percent selecting one of the imrrier cate- 
gories (softwardi hardware^ etc;). Besiring^ to raise the percentage 
selecting a barjrier category the base question was changed from *'I will 
teach more' science if /when. in the pilot- run to **I will teach science 
more effectively if/when*«/' in the survey* This resulted in a category 
wfilch was now labeled "I already teach science effectively; am already 
satisfied" with a response rate of 5 percent*' Tl^ Investigator accom- 



plished his purpose but left an interesting questibp* Was it possible 
that some of the respondents of the pilot group, who indicated that 
they already taught enough science, had indeed taught none 'Vhich to 
them was enough? One may ask how do we know that all of the respon- 
dents in both groups taught science?, 

The^investigator^ attempted to establish interrater reliability of the 
category 'classification process* In doing so the raters were told to 
ikS6"the investigator's procedure^ Including the statement that any 
response which saltH^^itax%rials** was, to be assumed to mean ^'software** 
aM^ndt"hardvare/' Kot only is it highly questionable to make such^ ) 
assumption but it has been this abstractor's field e?q>erience that 
teachers who were prepared for and use any of the newer programs of' 
elementary' school science, such as SAPA, SCIS, or ESS, will insist on 

" •'hardware*' when asked what they want in the Way of materials. The 

f * 

h » 

aasuitiption of the investigator becomes more acute when he indicateis^ 
that 20 p^^cent of the survey sample or approximately^ JOO teachers 
^ wer^ using SAPA, SCtS,,or ESS materials in their classrooms. How can . 
<me assured that the response percentages for the^ software category 
(38 percent) arid t^e response percentages for the hardware category 
(18 percent) are truly reflective of -th^^intent'*^ of the teachers* 
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responses? How many of this 20 percent 'of Che saniple had Inservlce 
preparation to implement a'nd teach the Identified programs? 

The Investigator does hot Indicate hot? many questionnaires were mailed 
to the 14 sc^iQol districts nor the nuiaber returned from all 14 school 
districts* There Is no^response ratio given and we have no ^lues as 
to th^ characteristics of -^he respondents versus t the *non-r^spondents* 
Random sampling was not used nor was there any ln<flcatlon that Hiie 

sample was equalized by random assignment, 

\ 

^^^The concluslonsi stated In three brief sentences; provide a very broad 
^response to the first, three stated purposes of the study but do not 
address the fourth purpose*. There Is no Indication that the Investlga- 
tor vlews^ Kat2*s apjJroach &s a vglld theory for establishing hypotijeses 
and designing experimental, studies^ to test attitude change of teiu:hers* 

... -J . ■ . • ' • A 

On a purely philosophical basis this abstractor could concur with most 
of what the investigator identifies as implications of tlija study *^ 
Hotfeveri to draw these Impllc^lons ^rom the data of the study is not 
- supported by the .abstractor* For exanq^ei tlibt investigator sj:ateS| as 
. an impllcatloni that ''^respondents, in this study suggested the use of 
aides for tl>ls purpose/* — the purpose being time t\^ prepare and 
assemble's'clence ecjulpment* ^ A reported two percent of , the re.sPonses 
inade this suggestion which, was hardly a significant num^ber anji a" ques- 
tipnable percentage for the state4 implication* In another Insjtance 
the investigator indicated th^ ''although the percentage was not high| 
respondents openly sanctioned the need to establish science as a 
legitimate subject in the local school curriculum/' There are no 
dfta or response categories provldM in' the report to support this 
statement* Similar comments may bjs made regarding other stated Impli^ 
/^catlons* By and large, the investigator has gone far beyond the' ddta 
' J^rovlded* - ^ v 

^In t'he^oplnibft of, the abstractor, this s(judy coul^ have been s'treng** 
thened significantly* Aside from previous comments it may be suggested 
that the open question format; of the pilot survey could have provided 
the basls'lfor a^osed question formal* Obtalhlitg factual infprmetion 



about ch^ respondents coulcf hav^ been combined with survey data and 
analyzed by correlational techniques. Such analysis might have pro* 
vtded more definitive clues as to why certain categories Received a 
larger percentage of responses and which categories and related 
factual information are functionally Indicative of teacher ^attitude. 
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Purpofio 

The stntcd purpose of this study was to determine the Influence of^ 
particular , high school biology programs and several background, varla*- 
bles on achievement In Ijeglnnlng college biology* 

... 

totlonfile V" 

I * 

On a subjective basis, most college biology teachers feel that BSCS 
biology programs at ^he high sqhool Xevel provide a better preparation 
for bcRlnnlng college biology than do otheir biology programs* A study 
of achievement In college biology by students with different high . 
school bacfcground .ls ijeeded t^^'^provlde evidence ^n which to base a 
concludlon* ^ 



Design And Procedure 

f 

The subjcfcts u3ed In this study were 857 freshmen students enrolled in 
beglnnlti}; biology' during one quarter «t towa State University* The 
stttdentH were distinguished on the basis of five fa<^tors: (1) which 
of six high school biology programs they had experienced <BSC!S Blue 
Version (BVl; Yellow Version tYV]j and Green Version tCVl; Hol-t, ' . 
RlnchAtt and Winston's* Brown Version [Brown]; other high schoal biology 
progr^mH [OB]; and.no high school biology [NB] , (2) the college In 
which they wer^ enrolled at the university, (3) the type of college / 
laboratory In which they were enrolled, (4) whether or not they had 



taken htgh school chemistry, and (5) sex* .Achievement of different 
gt<^up8 of students In beginning college bfology vas treasured by a 
final grade vhlch was based on tvo tests and a final exam* 

The manipulated variables of (he study laere the five student descrip- 
tion factors; the responding variable was achievement In beginning 
^llege biology* It appeared that an. attempt vas made to adjust for 
a scholastic ability and achievement variable though these variables 
were not mentioned* ' ' , ' 

i ^ 

Initially, product-moment 'correlations were calculated for each high 
School biology program and rav final grade* An exploratory multiple 
regression analysis Including the following variables appears to have 
followed: final grade In college biology:^ rank' in high school; scores* 
on the Minnesota Scholastic Aptitude Test (MSAT) , English Placement ♦ 
Test (ENG)* ^"Mathematics Placement Test (HATH): and the five student 
description factors listed previously* The MSAT and ^ATH were found 
to be significantly related to final grade, and two significant first 
order Interactions were Identified*- , ^ * 

The primary analysis' was an analysis of covarlance which used MSAT and 

HATH scores as covarlants with final grade to produce adjusted mean ' 

final grades* All significant differences between levels of the main 

effects and the two Interactions were presented* Finally, a multiple 

comparison Investigation of all posislble combinations of high sctiool 
* 

Uology programs w^s performed using least significant differences 
(LSD) tests. \ , ' 

Findings ' ^ 

The raw mean final grades for each of the, high school biology groups 

were: BV-2*52; YV-2*46; KB»2*31; Brown=2*30; GV-2*29; andOB=2%26*^ 
• * 

The analysis of covarlance Indicated significant (0*05 level of confi- 
dence) differences between the final grade means bf the six high ^school 
biology group^ and between a high school biology group by laboratory 

"as- 



Interaction, Significance at the 0,01 level is- reported for dif'fer* 
eaces of the meat ^^aal grW^ for. the variables^ chaaistry backgroundi 
s«c, and a qhemiatry by sex interaction,. Data for the interact iot](&^^.__^ 
are shown in 'Table 1; no other main effects or Interactions were, 
eignif leant, ' , ^ * 

ThQ LSD" multiple comparison of final grade and biology group showed 
significance nt the 0,05 level for GV vs BroiJ^and OB vs NB; ^,01 
level significance vas reported for BV vs OB, GV vs OB, YV vs Brown,- - 
Vt v8 OB^ and Brown vs OB, Mean grades for all othet combinations 
showed no significant difference. 



Interpretat ions 



The stated conclusions were that **students who- had participated^ in 
the OB versions achieved s?.gnlfl,cantly better," with the YV next, 
and GV third. No differences were found "between colleges, or between 
students who took a laborat<>ry, teased upon high school background. 
High school chemistry did produce- highly significant results,,, i Males 
differed from females at the one percent , level compared to females," 
.About the two significant interactions, it is concluded that, ^'labora- 
tory f or'^^l&a^ors seemed to be^.a contributing factor*' and "males who had 
higib scho<yi chemistry were Significantly different/* Finally. MSAT 
and MATH were found to be better predictors in college biology than 
rank In high school, - * 
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TABLE 1 ^ ■ ' .■ 

MEAN FINAL GRADES FOR BIOLOGY. BY LABORATORY INTERACTION 

>Ain) CHEMISTRY BY SEX INTERACTION* » 



■ " ^ _ ' 

jGroup 


No Lab^ 
Raw < Adjusted J 


Ma.iot's Lab 
Raw . ^d.lusted 


• Non^Ia.ior's Latt . 
Raw Adiusted 


BV " 




2.63- 


r 


2.72 . 




' i.90 ) 


GV 




^ 2.63 




. 3.23 




1.96 ■ ^' 


W 




246 . 




3.06 




- 2.05 


Brown 




12.20 




2.50 




. 1.79 : 


OB . 




2.74 1 




2.69 




' 2.30 ; 


NB 




1.71 




2.20 






Combined Groups t 


2.16 


2.13 . 


2.50 2.63 


2I32' 


2.25 






Male , J 




Female ' 


COTiblnedf Sex" " 




Rev 


Adjusted ■ 


^ Raw 


" Ad lusted 


.Raw 


Afljusted 


Chemistry 0 
No Chemistry 
*^ Combined Chemistry 




^2.W 
2^^7 
2.55 




2.43 
2.05 . 
2.13' 


-2.-41 
. ^^1.94 

t 


'^.53-- 
•'2.i5 I 



*Thls table was prepared by th^6 'abstractor. 



ABSTRACTOR'S ANALYSIS 



Evaluating the effects of high' school curricula onr achievement' lAjcollege- 
science Is a task worthy of sclenc^'educatlon^research^ but^J^ ha9^^roved 
to be a difficult one. Previoy^" studlesjof currlciilk (e.g. PSSC^ 

CHQf Study » BSCS) and.J*tradl£tonaI^"^^6ytMcu]^^^ve utilized several 
procedures and yielded Inconslsjitnt^cdnclusd^S as to the effect of 
these projgrams on a&hl^vem|p^ In college science. Most sttldles report; 
no significant- differences lir^tilevemerft^ In^ college^ based on high ^ ; 
school science cu^lcdcula <Ba1ah» 1972fJGaj-rett^ 1968; Hendricks et al«\ 
1963; Hudlk, 1969*, >tott, 1970j Og^en, 19J6)\ while a very Tew claiji such*- 

-IT; ' ■ , ' ' 

significance (Cothlngham, 1970)., The $tiilsslon of related , literature 
and an historical context llin^s the«^f^ni^lcan6e of this study to 
that of an Initial Investigation. "Ov^^"^^^ ^ . 
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Although a general design and series of analyses are suggested abbve» 
the procedures' analyses and ^ndlngs of this ^tudy are not clearly 
presented or Interpreted In 'the paper* ^e study would have been 
ISreatly Improved by more' specific, Initial planning. Initial analy-^* 
sis using raw final grades indicated that students vho took high 
School chemistry had a mean grade of 2*41 vhi^e those vhb did not 
averaged 1*94* (Table 1)*^ Although this result was sal4*to be . 
"expected^** no mention was made of the possibility and Importance i 
of controlling for ^the distribution of these two groups throughout 
the biology ^^roups* The same analysis indicated raw mean grades for 
the different college laboratory groups as follows: no lab - 2*16; 
major's lab - 2.50; non-major's lab - 2»32 (Table I). These were 
shown to be significant at the 0*05 level*^ Also presented'in the 
tsble is the result of a later analysis of covarlance which showad 
(hat sex had a significant effec^t on l«jRfe mean grade» males averaging 
^.55 and females 2.13 (although inspectl6n of the breakdown figures 
above this score in the table suggest that an error has been made; 
other data in the paper verify that the effect of sex on final grade 
was significant at the 0*01 level. )^ All three of these variables 
vere known* to 'have a, significant effect on final ^ade» but no mention 
was , made jOf'' techniques used to adjust the mean grade on this basis^ 
nor w^s an ef f ect *on the validity of the results a'hkiiowl edged* 
Uncontrolled distribution of these variables over the biology groups 
destroys the validity, of the statisticallprocedures used. 



' ( ; ; 

3 mea^^^ad by 



Achievement in college biology as meast^ad by raw mean grades for the 
six biology groups was profoundly effected by the adjustment of the' 
means based on MSAT and MATH scores^ e*g* the OB group which. had the 
lowest achievement based on raw meaos was said to have the highest 
achievement after the means were adjusted. Despite the Qtagnitude of 

.this data manipulation^ no rationale^ no description^ of how the ^ 

* ^ 

multiple regression analysis was carried out and no data resulting 
from th>e regression analysisvere presented* The actual adjosteii me^ 
grades for each ibiology group are not reported; they are said^o be . 
presented in a si<ecif ic table^^ but they do not appfi^r. Without these 
means only difference scores are available to measure the affect of ' 
the different variables on Jinal grade; the directions of the 
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differences found by the analysis of covariance and the LSD multiple 
comparison cannot be inferred *£rom data presented*, ^ 

The generation of the all-important responding ^variabl^^ mean grad^ 

In college biology^ vas not clearly described* The relationships of 

the different lalioratories to the biology course and ^heir pdssible' 

direqt effect on the final grad« vas not discussed nor was It clear 

that all^the students, vere enrolled in the same beginning biology 

course^ Additional, ambiguity vas introduced by a few apparently 

typographical and technical errors sucli as the statement that **the 

better student took YV*' when the data being Interpreted specified 

that the BV group had the higher mean grade* Nhile the style of 

writing imposed by many Journals due to space limitations often 

ir^s omissiops and cryptic phraseology^ it is important to 

Information which^ i^ill allow a reader to reconstruct the 

at^alysla and^ if possible^ to carry out othet analyses of the data 

t'have been obtained, 

* - T * 
\ • 

This paper deals with an important topic &nd contains valuable data^ 
^hut the data analysis is inadequate to support the conclusions' pre- 
sented* The literature 'describing Investigations of this type 
suggests several approaches to the analysis of data; J recommend^ as^ 
a models the paper by Hendricks (1963), Several additional student 
variables have been analy^d for effect; age^ mathematics background^ 
and SAT scores as veil as chemistry ^and ^ex have been reported to be 
slgnific'ant (Ogden^ 1976)* I voul'^ be very interested In seeing the 
data reported in. this paper reanalyzed ta remoye the difficulties 
cited above. It would make $. valuable contribution to science educa-' ' 
tlon and^ more fSpecif ically^ to higtl school textbook selection ^ 
committees* 
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California, San iJiego-La Jolla, California, February, 1976* 
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Expanded Abstract and Analysis Prepared Esp^ially for I.S<£< by ^ 
Berbert A, Smith, Colorado State University- / 



Purpose 

The stxidy investigated the validity of prerequisite low^ Vision 
course -grades ^s. predictors of grades^in upp^h: division sciencj 
major areas * 



Rationale ^ 

As indicated in the study, prerequisite courses' are nor^mally required 
as a condition of enrollment in upper division courses*. These, 
requirements are usually justified on th^Wsis of ^providing neces^ 
sary' content, providing practice in the use of skills in ^ 
quantitative problem solVing^and as an efficient screening mechanism 
of studentdb. for advanced stxidy* Is this a reasonable and valid 
practice? This study addresses itself .to this (iqestion**- 



■ Researcfi Design and.Prpcedure ♦ " ' 

■ 

0^ hurtdted ninety-five college students who.gr^duat^ed from the ''^ 
Diliversity of California, San Diego, in the s^rTrig.of were the*^ 

subjects of this study* The students- were in ^even different" majors: 
applied physics and information science, applied mechj^nics and^ 

engineering sciences,* biology (two programs)j_^chemistry, •tl^the- ' 

,* ^ 

matics and physics* The procedure ^used in the study involved ' ^ 

* ** " 

analysis of the students' rj&cords to ot?tain an avetage, grade in \ 
tjh'e several prerequisite courses' and the^ average grade in upper 



division courses In the students' major area, A correlation analy 
sis was then made In which blvarlant and nultlple regression 
*C06ff Icl&nts tiere obtaliled to provide a measure of s^latlbnsblp 
between tlve varlabieSn* the resixlts are succinctly summarized In 
tabular form. 



Ffndlngs * * ^ * 

Tt^ findings clearly demonstrate^ that the prerequisite courses have 
relatively high , validity as prje^ctors of success In later upper 
division courses In the curricula Included In this study* 



Interpretations 

The authors conclude that the prerequisites are Justified on the 
basis of their findings. They suggest the usefulness of regression' 
modelis to counselors and academic advisors in helping students make 
d^islons about their future areas of study and| by Inferencei 
thdlr probable success in pursuing more advanced-study* 



ABSTRACTOR'S ANALYSIS 

This' study 1^ perhaps not highly original or innovative* But it is 

t 

straight-forward I loglcali well written and something of a model for 
clarity* Conslde the small samples for a correlational stifdyi 

,it is surprising that all correlations were significant; most of 
themi including all the multiple correlation coef f iclentSi at the 
one percent level* The study would appear to validate convincingly 
the use of prerequisites as predictors of Success in more 'advanced 
courses in scientific fields* The ^f act that physics grades t^re 
the best predictors of later performance in four of the seven major 
areas (but strangely enough, not in physics) is intriguing* As 

'Indicated in the datai undergraduate mathematics grade^ appear to 



be'better predictors for upper division physics gradfes, while lower 
division physics grades ape better^ predictors of upper division 
nat^emat Ics grades. Presumably the differences between the coeffl- 
Ctents are not statistically significant* It does> hoveVer> suggest 
that some additional study .ls^ warranted. 

The questlpn of the validity of prerequisites In other fields'' 
remains unanswered. On a priori grounds ojne would expect the 
Validity of prerequisite courses as predidlKirs of later success in^ ^ 
.up^er division courses to be greater in fields with strongly developed 
structure such as mathematics, science and possibly economics or in 
fields with a relatively fixed sequence such as foreign languages, 
than in humanities, history or the less quantitatively oriented-' 
social sclencesi 

With the pressure to admit students of varied baclcgrounds, ^ages ^ndl 
experience, there is of ten;pressure to waive or eliminate prerequl- , 
site courses, " _ 

One Interesting question suggested by t^e stu4y is the relationship 
of institutional policy on prerequisites and the quality of the 
institutional graduates. When prerequisites are either discouraged 
or easily waived, it wbuld appear ta be difficult 'to maihtain stan- 
dards In upper division courses, ^ An extrapolation of this study 
would Support this view» at least in science fields, and raises a 
general question about other academic and professional areas* ^ , 
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federsetif Arne'A, and Judith E, Jacobs, "The Effect of Grade Level 
op Achievement in Biology," \Journal of Research in Science 
Teaching , 13(3):237-241» 1976, 

Descriptors — ^Academic Achievement; Age Differences; ^Biology; 

^Educational Research; ^Instructional Program Divisions;* 

Science Education; Secondary Education; ^Secondary School 

Science " ' 

'V • ? . . • 

Expanded Abstract and Analysis Prepared Especially for I,S,E, by 
Ellen Stephanie Siinmons» Teachers'Callege, Columbia University, * 



Purpose ' * * 
- -* 

\ 

Y 

According to Pedersen and Jacobs, th^ purpose of 1;hi^ study was '*,,,to 
determine whether there was a difference in achievement between ninth** 
and tenth-grade students upon' completion of a. year of biology," 

■ ■ > ^ .. : ' 

Ratidnale , 

After reviewing the literature- on this to|>ic, the authors concluded 
that th^jrevious studies were conflelctlng in naturae and" narrow In 
scope. Hence, an Investigation involjring a large number of ninth- 
4nd^tenth-grade sii^^cts with diverse abilitie^ wa^ deviled which 
Controlled for many extraneous variables inherent in the eai;lier 
^laearch, * ^ 



ReSjearch Design and Procedure , , 

\ ' " , ^ 

'This study was conducted over the course of one academic year involv*^ 
Ing all ninth-grade (684) and all tenth-gr^e students (721) from 
TOttenvllle High School, Staten Island, New Yorfc^ An'even mixture 
of ninth;* and 'tenth-f;r^de students was employed! within 'e^ch cla^ss, 
F^rthermpre, the classes contained puptts from a wide continuusi of ^ 
abilities;, this larger spectrum of ab.ilities was deemed necessary in 
order Tto offset those weaknesses found in the earlier research vHich 
tended to select only a small .number 'of .subjects and usually focused*^'* 
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especially on the b^lghtei:^ students. Eighteen tcdchers ver^ involved 
In the project; thus, extraneous variables, Including terfcber compe- 

^ tencyi cla'^srocm conditions^, and course time, vere controlled because 

V both groups were expbsed on a random basis* 

At the cQfUpletlon of the ye^r^s studyi all subjects vere tested at the 
same time with absenteeism beliig minlnuil (16 ulnth-gradei 20 tenth- 
'grade)* A comprehensive multlple-cholce test covering the year's 
course of study was prepared by a committee of experienced biology 
teachers; While the test's reliability was not calculated,^ Its 
validity wa^ verified by- the faculty involved, 

. The scores attained on^hls test were divided Into the two class 
groups, and the mean for each group,* as well as the range and the 
standard deviation, was calculated, A t-test for Independent means 
with 0.05 level of significance was performec^r After grouping the 

^ Individual scores Into Intervals (selection wa^ based upon teacher 
.Interest'fe), a chl-^quare test was employed to determine If a 
significant difference existed at the 0,05 level between the grade 
.distribution for nlnth^graders and the grade distribution for tenth* 

, graders, ^ ^ [ , 



No significant. dlf,ference was found to exist between the mean scores 
i<>X each gracK level^ and the difference In grade distribution was 
negligible. The t-test for determlnlns the difference In mean scores 
showed a t-value of 1,72 which was not significant at jthe 0,05 level, 
Jhe chl"Square analysis for grade distribution resultet^ In 9,69 which* 
v^^. pot. significant a-t the 0,05 leyel-, ' ^ ^ 



Interpretations , , 

S^nce no"" significant- difference was found In' either statistical analy- 
tlSi the researchers Inferred* thit nlnth-grade students do have the 

58:* • . ^ , ■ 



teckground and ^he capacity to succeed In biology. Furthermore^ the 
authors believe thdt their study suppoi;ts those whg have proposed' that 
Mology should be taught on the nlnth*-grade level; this conclusion 
Is based on '^the authors* use of a larger, number of subjects' with 
diverse abilities* 



ABOTllAcxoR^s analVsis 

' ■ . \ - ■ 

The authors qf thlS; research report convey their Information succinctly^ 
thoroughly^ and preclseljiC The format used helps? the reader clearly 
and quickly understand the totality of the Investigation, ,the problem 
aoalyzedy the process used^ and the results achieved. As a result of 
these many attributes^ this Investigation as reported has demonstrated 
that ninth-grade students should be pannltted the opportunity to study 
blplogy*. ^ t 

This conclusion was reached after a careful study of tSie' literature and 
after developing a research deslgti devoid of the deficiencies' in previous 
studies. Their Investigation Is unique In the employment of. a larger 
number of subjects (using- all ninth- and tenth^-g^ade students with 
diverse at)llltles attending- a larg^ urbari high school). Unf ortynately.^ 
th^ authors did not quantify the 'Varying abilities*'* * ^ 
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Bbwever^ several attributes are found In this studyt 

1* The- mixture of ninth and tenth-grade students within Indl- 
vldual classes — this controlled for subject matter 
'presentation bias* - ^ ^ 

, 2# The final examination was prepared b^ a committee of biology 
^ . teachers~thls Insured that the test content dealt 'with the 
entire yearns curriculum and eliminated tester bias. 

~ '3# The final examination was administered simultaneously to 

' 1 7 ji ^ , *r ^ 

:alX subjects — ^thls. alleviated any bias in' testing conditions. 



Xn addition to these attributes^ careful attention was also given to 
the research design,^ The ufse of a t-test fof evaluating and compar- 
ing the mean scores between grade levels was most appropriate as was . 
the use of. the chl^square for evaluating the significant (ilffetence In 
the grade distribution for the ^"^fo^groups^ According to the^authors^ 
they chose unequal Intervals with logical care^ keeping In mind the 
Interests of classroom teachers. While the chl-square test using 
unequal Intervals was shown to be not'statlst^ally significant^ 
vould be Interesting t% reanalyze the data using equal, Intervals except 
for the first, from zero to 50* Since such great care was taken with 
the statistical analysis of the data» it seems unfortunate^ however^ 
that no quantitative techniques were employed to assess the reliability 
and validity of the- achievement test (content Validity was only subjec- 
tively determined by the biology faculty), ' ^ 



Therefore^ the conclusion reached by the authors appears to b^ well" 
founded — that ninth-grade students would seem to have the background 
and the capacity to succeed In biology* The authors also suggest that 
as a result of being able to take biology" In the ninth-grade^ students 
will have more opportunities to select 'course^ which be^t meet their 
Individual needs and Interests, ^ ^ ^ 
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A BBSIWSE TO THE ANAI^SXS. OF 



Wlllson^ V< L< and A< M* Gai;11)aldl< **The Association Between Teacher 
Participation In NSF Institutes and Student Achievement 'by 
£« J, Davis, Investigations In Science Education ^ 3(i)j58-61>, 
1977, 



Tlctor. L,, WlLlson 
University of South Dakota 



Volume '3» Issde 1 contained an abstract and analysis, of an article 
first publlshed^ In the Journal of Besearch In Science Teaching (1976) 
The abstract and analysis were prepared by Edward J* Davls« There 
ar^e several distinct points of the criticisms ^f D^is ^Ich will be 
addressed in this response* 

The data analysis reported was part of a five-year evaluation grant 
to Dr, WSiyne Welch to study effects of selected NSF projects (Welch 
and Gulllcksoni 1973), The evaluation included an initial assessment 
of several hundred teachers in science^ and mathematics and conccmil- 
tadt assessment of one of their classrooms. Davis questioned the 
randomness of the sampling procedure in the selection of teachers^ 
who>ere supposedly selected randomly by principals from a stratified 
sys.tematlc sample of schools in five geographic regions* No direct 
investig atio n of randomness was made^^but indirect evidence was 
collected by examining the characteristics of the teacher sample 
Dumber of years in teachings numt/^r of credit hours of science and 
viath» highest degree earned were compared between the ERIC sample 
(Schlesslnger^ et al ^^ 1971)' and the Welch sample. The two 

samples were ^ulte similar (Dr« Wayne Welch» Personal Coimnunlcatlon^ 
1978^ • ^ . ^ ^ 

Another erlt^iclsm of the article was centered on the ^construction of. 
the achievement tests used* In mathematics the National Longitudinal 
Study of Mathematical Abilities (NLSMA) item set formed the basis for 
test construction* At grildes eight; and Eleven » items were content 
fcategor Izec^'^nt o number system, algebra, and geometry. Each was isub- 
divided into four taxonomlc levels:- computation^ cotnprehension^ 
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application^ and analysis* Mathematics educators formed an expert 
panel Co decide percentage contrlbtltlon of each content* subarea to 
reflect current curricula. Items, were selected to have difficulties 
bet^jf^en ,5 and ,9 with polnt-biserlal correlations greatei^than ,3 
vlth the original NLSMA. scales* Further revision and a pll^ot test 
in public schools followed, with flna^ revision* In science a 
con^arable process was followed using National Assessment of Educa- 
tlonal Progress (MAEP) Science Assessment Items released from the 
1968 assessme nt* Attitude and process measures administered in the 
study were discussed in other published articles and are not directly 
relevant to the paper* Technical descriptions of tjie tests are avail- 
able from Dr* Wayne Welch, University of Minnesota^ Minneapolis^ MN 
SSASS* See also Lawrenz (1972) and Sandmjan (1972)* 

4he last point of criticism was considered most important .by the 

reiriewer* He suggested t^e gain associated with institute attendance 

was too little ^(about 2 points on the 40-ltem tests) to warrant signl- 

ficanttattentlon or to recommend institute attendance* There are 

several features of the gain ignored by the reviewer* . Firsts it is 

* 

the average gain over a large number of classrooms* There have been 

^ * 

few educational effects shown to be this large in any studies of 
achievement* Next » the gain can reasonably be compared with gains 
of similar magnitude on standardized science or mathematics achieve- 
ment tests* Two points^ on a 40-item test represents a 5 perbent 
absolute gain (and 10 percent on the base level of about 20 correct 
for the F^oorest grof^ps) * In Table .1 are listed comparable gains and 
their interpretations in terms of group mgans. as published by the* 
first two tests I had immediately at hand* 

The magnitudes of .gains for the classes in the Willson and CEarlbaldi 

study are comparable to very large average school g§in^ on the STEP 

* 

and ITBS te%ts* While grade equivalents are crude at best, the ITES 
gains of about four months in grade 8 math are probably quite compare 
able to the gains of the STEP tests» which don^t report grade equiva- 
lents* Any program which can producfe an average four^month gain in 
classes is worthy of consideration^ as was discussed in Willson and 



Table 1: . Comparable. Mean Gains for KSF Data %et and. Several Standardized Teat Norm Groups 



Initlal--Mean„ Percent 

.Difficulty' " Gain of 

of Test for * Raw Total 

Comparison -Gain Items 



Percentile 
Grade Rank Gain 
Equivalent for School 
Gain Me'ans 



Comments 



1< IISF Data Sample 

(Wlllsonand Garibaldi) 



Science 
^(40 Items) 



Math 



<40 Items) 



Gr, 11 

Gr, 8 

Gr, 11 

Gr< 8 



2. STEP - Series II 

School Heaia iSorms (1971) 



Science 
(75 Items) 
X50 Items) 



Gr, U 
Gr, 8 



Math Basic Concepts 
(50 Items) ^ Gr, U 

(50 Items) Gr, 8 

hath Computation 
<60 Items) Gr, 11 



(60 Items) 



Gr, 8 



2. 



nSS - Form 5 (1974) 
School Mean Itorms 

Macheniatlcs Concepts 
(30 items) Gr. 8 

Hath Problem Solving 
(30 items) Gr,' 8 



,56 
.56 
,57 
,51 



. -55 
.63 

.49 
• 59 

.57 
:. .62 



.75 
.47 



; 2.14 
^ .95 
. .2.01- 

' 1.77 




1.33 



; i4^ 



5.35 
2.38 
5.03 
4.43 



■4.01 5.35 



2.^8 

5.03 
4.43 

,5.35. 
4.43 



4.43 
4.43 



+24% 
+11% 



+23% 
+21% 

+31% 
+13% 



>4 
.4 



+20% 
+73% 



Initial, mean 
difficulty Is tt^e 
mean score for 110 
TiST Institute 
attendance divided 
by number of Itema 
In the tSBtt ^ ' 



— . Initial mean dlffl; 
^\ culty Is the mean 
school raw score 
, divided by number 
^ of Items on th^ 
test as teported 
In test manuals* 



Garibaldi* /The conclusion remains the $amei participation In'^ln-* 
service 'ln$\^tutes by teache;cs appears quite beneficial tO'TStudent 
achievement < 
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